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(57) ABSTRACT 

Apparatus and methods of compensating for distortions 
introduced in communication signals received over a tele- 
phone network. An adaptive linear equalizer (LE) pre-filter 
is used for filtering incoming sampled communication sig- 
nals received via the telephone network transmission 
medium. An adaptive decision feedback equalizer (DFE) is 
used in conjunction with the LE to provide error filtering as 
a hybrid equalizer system to determine which of a plurality 
of communication states of the sampled communication 
signals as an accurate estimate of the originally transmitted 
signals over the transmission medium, responsive to the 
filtered communication signals from the LE. An error signal 
is generated relative to the difference between the deter- 
mined states of the decision mechanism of the DFE and the 
filtered communication signals from the LE. Further, an 
error filter provides a filtered output of the generated error 
signal, wherein the error filter has an error filter character- 
istic defined in accordance with the known telephone net- 
work transmission medium. The LE for the received 
sampled communication signals has a LE pre-filter charac- 
teristic defined in accordance with the filtered output of the 
error filter, using a recursive least-mean-square (LMS) tech- 
nique. 

20 Claims, 5 Drawing Sheets 
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ERROR FILTERING IN A HYBRID 
EQUALIZER SYSTEM 

COPYRIGHT NOTICE 

A portion of disclosure of this patent document contains 
material which is subject to copyright protection. The copy- 
right owner has no objection to the facsimile reproduction 
by anyone of the patent document or the patent disclosure, 
as it appears in the Patent and Trademark Office patent file 
or records, but otherwise reserves all copyright rights what- 
soever. 

BACKGROUND OF THE INVENTION 

A. Field of the Invention 

The present invention relates to methods and apparatus 
for reducing distortions in sampled communication signals 
received over transmission media, and more particularly 
relates to error filtering in a hybrid equalizer system for 
generating an accurate estimate of the original transmitted 
signal. 

B. Description of the Related Art 

Linear and decision feedback equalizers are commonly 
used in communication receivers for computer systems 
providing applications such as multimedia, modem 
communications, optical and magnetic storage devices, and 
wireless systems. In high-speed modem data communication 
systems, it is often advantageous to incorporate an adaptive 
decision-feedback equalizer (hereafter referred to as DFE) in 
conjunction with an adaptive linear equalizer (hereafter 
referred to as LE). For computational efficiency, the least- 
mean-squares (LMS) algorithm is often used as a method for 
adapting the coefficients of the equalizers. 

LE and DFE structures have been studied in detail for 
their simple structures and adequate performance over well- 
behaved channels. The DFE has enjoyed some success as a 
form of equalizer for data communication receivers that 
attempt to eliminate intersymbol interference (ISI), due to 
the DFE's simplicity and its ability, unlike the LE, to 
perform well over channels having spectral nulls, while 
advantageously providing a- structure without noise 
enhancement. However, the fundamental problem with a 
LE/DFE system is that, for impairments that can be miti- 
gated by either the LE or the DFE, deep convergence of the 
joint system is very slow, sometimes on the order of millions 
of symbol periods. 

Equalizers may operate in a continuously adaptive mode 
to track variations in the communications channel. Such 
continuously adaptive modes, however, typically require a 
significant computational burden. A method of alleviating 
this computational overhead in a continuous adaptive mode 
is to adapt the equalizer coefficients periodically based upon 
a known training sequence. However, channel mismatch still 
occurs due to problems with periodic training and the like, 
and an inability to be optimized for considerable channel 
fluctuations. Computer simulations have been found useful 
for predicting channel fluctuations for equalizers, but the 
computational requirements still may be quite significant. As 
described in U.S. Pat. No. 4,985,902 to Gurcan for "Deci- 
sion Feedback Equalizer and a Method of Operating a 
Decision Feedback Equalizer," issued Jan. 15, 1991, a 
method attempts to optimize the peak reference tap of a DFE 
by optimizing the mean square error (MSE) performance of 
the DFE in the presence of arbitrary channel mismatch. 

Gurcan makes the assumption that increasing the number 
of feed-forward taps improves the MSE performance. U.S. 
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Pat. No. 5,513,214 to Gozzo for "System and Method of 
Estimating Equalizer Performance in the Presence of Chan- 
nel Mismatch," issued Apr. 30, 1996, however, indicates that 
while increasing the number of feed-forward taps may 

S improve performance under ideal conditions, such is not 
always the case under severe channel mismatch conditions. 
Gozzo observes that existing performance estimators either 
found the MSE by ignoring channel mismatch, or calculated 
the MSE using cumbersome and/or expensive analysis or 

10 simulation techniques which are not amiable to real-time 
applications. Therefore, Gozzo attempts to provide quick 
estimation of equalizer performance under arbitrary channel 
mismatch conditions to predict the MSE performance of the 
LE or DFE structure when training the equalizers, assuming 

15 a finite length non-recursive type LE. Lee, "A Fast Com- 
putation Algorithm for the Decision Feedback Equalizer" 
IEEE Transactions on Communications, Vol. 43, No. 11, 
Nov. 1995, also describes a non-recursive MSE- DFE struc- 
ture for achieving faster convergence. Such non-recursive 

20 LE solutions for estimating of equalizer performance using 
MSE estimation still require considerable computation capa- 
bilities. 

Previous solutions to the rate of convergence problem 
have involved, either directly or by some approximation 

25 method, collecting data to determine an autocorrellation 
matrix, then the inversion of the autocorrellation matrix to 
extract initial coefficients. In directly inverting the autocor- 
rellation matrix, extreme precision and intense computation 
are required, which becomes unrealistic for LE/DFE struc- 

30 tures of some length in a real-time application. Other meth- 
ods employ one or more approximations to the matrix 
inversion which adversely affect initial convergence, often 
achieving results inferior to simple joint LMS update. It 
would be desirable, therefore, to provide faster convergence 

35 of the LE and DFE coefficients using a recursive adaptation 
algorithm. 

SUMMARY OF THE INVENTION 

4Q It is an object of the present invention to work on the 
disadvantages of prior art equalizer systems for generating 
accurate estimates of sampled communication signals 
received over transmission media. 

It is another object of the present invention to provide 

45 error filtering in a hybrid equalizer system. 

It is a further object of the present invention to provide 
apparatus and methods of compensating for distortions 
introduced in sampled communication signals received over 
a transmission medium to obtain accurate estimates of the 

50 original transmitted signals. 

A described embodiment provides for the compensation 
of distortions introduced in high-speed data transmission 
signals received over a telephone network. An adaptive 
linear equalizer (LE) pre-filter is used for filtering incoming 

55 sampled communication signals received through the high- 
speed data transmission channel. An adaptive decision feed- 
back equalizer (DFE) is used in conjunction with the LE to 
provide error filtering as a hybrid equalizer system to 
determine which of a plurality of communication states of 

60 the sampled communication signals is an accurate estimate 
of the originally transmitted signals over the transmission 
medium. An error signal is generated relative to the differ- 
ence between the determined states of the decision mecha- 
nism of the DFE and the filtered communication signals 

65 from the LE. Further, an error filter provides a filtered output 
of the generated error signal, wherein the error filter has an 
error filter characteristic defined in accordance with the 
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known telephone network transmission medium. The LE for 28, and 30. The sum of the input samples Xn multiplied by 

the received sampled communication signals has a LE tap weights 22, 24, 26, and 28-30, which are summed using 

pre-filter characteristic denned in accordance with the fil- a series of adders provide an output signal 32, Yn. Equation 

tered output of the error filter, using a recursive least-mean- (!) for me LE convolution may be written: 

square (LMS) technique. By filtering the error appropriately s 

to each of the LE and DFE, using LMS update or any other ' (i) 

convergent recursive tap update algorithm, significantly ~ Zj c * ' Xn ~ k 

faster deep convergence of the joint structure may be * =0 
achieved when the spectrum of the received signal is 

approximately known. 10 piG. 1 and equation (1) demonstrate a real-only irnple- 

Briefly summarized, the present invention relates to appa- mentation but it is contemplated that software may be 

ratus and methods for compensating for distortions intro- provided in an embodiment using the complex number 

duced in sampled communication signals received over a domain in common practice and without loss of generality. 

transmission medium. Apre-filter is used for filtering incom- ^ di S ital si S nal processing for implementing the described 

ing communication signals received via the transmission 1 5 embodiment may be carried out on conventional DSPs such 

medium. A decision mechanism is then used to determine as the Tcxas Instruments TMS320C5x Series processor. In 

which of a plurality of communication states of the sampled th , e Ascribed embodiment, the LMS algorithm is used to 

communication signals was originally transmitted over the thc wl f h wdl * nd t t0 t ™ izc the mean " 

. . . , «n «j * square error (MSE), where err =OutputYn-Decision Dn, in 

transmtss.on medmm response to the filtered commum- a 4 recursive ^ rea ", variable implementation , of 

cat.cn signals from the pre-filter. An error signal generator *> ^ ^ ^ ^ 

generates an error signal relative to the difference between 

the determined states of the decision mechanism and the c ni-»+i)= c k('-»r err « x (n-*y a ( 2 ) 

filtered communication signals from the pre-filter. Further, , . „ 

_ , nmm . . „ ?h„„j t u„ „ mr where a is a small number less than 1 which may be 

an error niter provides a filtered output 01 trie error signal . , • • „ . , .t_ t * ■ \- 

. , . , t u • *u is determined empirically, based upon the characteristics 

generated by the error signal generator, wherein the error 25 £ £ , • L 1 

5 n . £14 i_ * • *• j c j • j or the communication channel, 

filter has an error filter charactensuc defined in accordance nG 2 shows ^ DpE smTe a 4Q ^ b 

with the known transm.ssion medium. The pre-filter for the (o ^ ^ w ^ ^ ^ ^ a havi 

received sampled communication signals has a pre-filter . . , , « ... ... * #u «i* 

. . \, , . • j ii. at* j tap weights adjusted by a criteria which generates the filter 

charactenstic that adapts m accordance with the filtered r j *• r n, r>T-cjff r J!\u t e? • *u * *u 

J* , 1 , • • * in response adaptively. The DFE differs from the LE in that the 

output of the error filter and the characteristics of the ™ ^ fm ^ J QVoMion fe a ^ of ioilsl 

received sampled communication signal. determined decisions Dn, as follows: 
BRIEF DESCRIPTION OF THE DRAWINGS 

v_i (3) 

The foregoing and other objects, features or advantages of 35 y « ~ 2j d «-*- 1 ' Ck 

the present invention may be more readily appreciated by *"° 
reference to the disclosure when considered in conjunction 

with the accompanying drawings and the detailed descrip- Again, the tap weights may be adjusted by the LMS algo- 

tion of the preferred embodiments described below, in rithm for computational efficiency. 

which: 40 In FIG. 2, the DFE structure 40, receiving an input signal 

FIG. 1 illustrates a linear equalizer (LE) structure which 42, Xn, which is added to a feedback signal Yn at adder 44. 

is used to modify properties of a signal by convolving a The combined input and feedback signal is presented to a 

sequence of input samples in a finite impulse response (FIR) decision mechanism 46 or slice r for determining one of a 

filter structure; plurality of communication states of the sampled commu- 

FIG. 2 illustrates the decision feedback equalizer (DFE) 45 nication signals from input 42. The decision mechanism 46 

in which a decision mechanism and a convolutional sum is based upon the constellation signal set of the modem, in 

generates an adaptive filter response; accordance with, e.g., the recent PCM class modems, or 

FIG. 3 is a block diagram showing a LE/DFE combined P rior technologies such as the V 34 modems and the like, 

structure in which joint error from the DFE is used for The DFE 40 uses the previously determined communication 

updating filter tap weights; 50 states in the convolution to provide a feedback signal. The 

t-t^ a i_ (i 1 j ' • «• ». j • • , output of the decision mechanism 46 is presented to a series 

FIG. 4 shows a block diagram in which filtered joint error - *, t . . - A , e K , , 4 , 

« . . . , S\. t f 1 j of delayed elements 50 and 52 . . . 54, and much as the 

is used in weight update of the LE taps; and convolutional sum of the LE structure, delayed decisions Dn 

FIG. 5 shows a block diagram in which filtered joint error are weighted by a plurality of tap weights 56, 58 . . 

is used in weight update of both of the LE and the DFE taps. 5S 60 and 62 ^ output of the convo i ut ional sum in which 

nPTAii nn nPQPPiPTinM op thp coefficients C are multiplied by decisions Dn are then 

"""SSS^^SSS^ summed to provide an output *Yn which also providesa 

feedback signal to the adder 44 at the input of the DFE 

With reference to FIG. 1, the LE is embodied as a filter structure, as discussed above, 

structure used to modify properties of a signal by convolving 60 The DFE structure 40 also provides for the generation of 

a sequence of input samples Xn with a sequence of weights an error signal relative to the difference between the deter- 

("taps") Ck where the weights are adjusted by a criteria mined states of the decision mechanism and the input to the 

which generates the filter response Yn adaptively. The decision mechanism. Herein the difference between the 

convolutional sum structure of the LE 10 takes an input input to the decision mechanism 66, and the output of the 

signal 12, Xn through a series of delay elements 14, 16, 18 65 decision mechanism 68 provide an error signal 70. Thus, the 

. . . 20, for multiplication with weighting coefficients CO signals provided by the DFE 40 are the decision signals 68 

through Cj as a first plurality of tap weights 22, 24, 26 . . . and error signals 70. 
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An advantage of a DFE structure is a lack of noise With reference to FIG. 5, an alternative embodiment 

enhancement, since decisions, assuming they are not in provides a filtered joint error used in the weight update of LE 

error, are noiseless. A disadvantage is that the DFE can only and DFE taps shown generally at 106, wherein, in addition 

work on the post-cursor portion of the channel impulse. A to the previously described LE 86 and DFE 90 combined 

structure used to achieve the advantages of both the DFE and s structure, error 104 filters, herein LE error 94 filter 102 and 

LE structures is in FIG. 3, where the decision error jointly DFE 90 and 94 error filter 108 provide error signals 104 and 

drives the convergence of both equalizers. The joint error 110 respectively to update the respective tap weights for the 

being used for the LE/DFE weight update structure is shown LE 86 and DFE 90 arid 94. The outputs of separate LE and 

generally at 80, wherein an input is provided at 82 and a ppE 90 and 94 error filters, 102 and 108 are used to adjust 

decision 84 is > derived from the combined LE^DFE structure tf fi Q g8 and Q 

Herein, an LE 86 provides its output to a DFE 90 such that g2 v v v & J 

weighting coefficients Ck and Cj are provided at 88 and 92 * e , . _ . . , , 

respectively in response to an error signal 94 from the DFE ^f. P rcferred embodiments for error filtering in a hybrid 

90. Thisstructure is particularly good at equalizing channels equalizer system having been described, and, more 

with deep spectral nulls in the transmission band. particularly, the compensation of distortions introduced in 

By filtering the error appropriately to each of the LE 86 * s sampled communication signals received over known trans- 

and DFE 90, see FIG. 4 and FIG. 5 discussed below, using mission media will make numerous changes and modifica- 

LMS update or any other convergent recursive tap update lions apparent to those skilled in the art that may be made to 

algorithm achieves significantly faster deep convergence of the described embodiments without departing from the true 

the joint structure may be achieved when the spectrum of the spirit and scope of the invention. Thus, it is intended that the 

received signal is approximately known. In the described 20 present invention be defined by the appended claims, 

embodiments, the channel to be equalized is a voice-band What is claimed is: 

channel with a null at DC and a partial null at 4 Khz for an \, An apparatus for compensating for distortions intro- 

8 Khz symbol rate, based upon knowledge of the base band duced in sampled communication signals received over a 

signals. Such spectral characteristics are found in the new known transmission medium, comprising: 

class of PCM modems. The error filter characteristics are 9 * n flu „ r - , , ■ 

, , , . - . A . Z3 a pre-nlter tor filtering the sampled communication sig- 

thus related to the spectral shape of the communications r , or 

channels herein being related, e.g., to the voice-band chan- ' 

nel of a digital telephone network (DTN). a decision mechanism for determining one of a plurality 

Referring to FIG. 4, a filter is applied to the error that is of communication states of the sampled commumca- 

used to adjust the LE coefficients. The filtered joint error, 30 tion responsive to the filtered communication 

i.e., the error signal 94 filtered by an LE error filter 102 Agnate from said pre-filter, 

provides an error signal 104 which has been filtered for use an error signal generator for generating an error signal 

in updating tap weights Ck 88 in the LE 86 of the combined relative to the difference between the determined states 

structure referenced at 100. Thus, the output of the error of said decision mechanism and the filtered communi- 

filter is used to adjust the first plurality of tap weights Ck 88. 35 cation signals from said pre-filter; 

Advantageously, the apparatus 100 provides compensation a n error filter providing a filtered output of the error signal 

for distortions introduced in the sampled communication generated by said error signal generator, said error filter 

signals 82 received over a known transmission medium having an error filter characteristic defined in accor- 

wherein the LE 86 provides a pre-filter for filtering the dance with the known transmission medium; and 

sampled communication signals and the DFE 90 then deter- 40 said pre . mter having a pre -filter characteristic defined in 

mines one of a plurality of communication states of the accordance with the filtered output of said error filter, 

sampled communication signals responsive to the filtered 2 . An apparatus as recited in claim 1 wherein said 

communication signals from the pre-filter, LE 86. The error pre -filter comprises a linear equalizer (LE) comprising a 

signal 94 is generated relative to the difference between the con volutional sum of the sampled communication signal 

determined states of the decision mechanism, e.g., decision 45 with a first p i ura ii ty 0 f tap weights, 

mechanism 46, of the DFE 90 and the filtered communica- 3 An apparams as reciled in clairn 1 wherein said decision 

tion signals from the signal provided from the LE 86. The mechanism comprises a decision feedback equalizer (DFE) 

LE error filter 102, herein, LE error filter 102, thus provides comprising a convolutional sum of multiple previously 

a filtered output of the error signal 94 of the DFE 90 which determined communication states with a second plurality of 

has an error filter characteristic defined in accordance with 5Q t weights 

the known transmission medium. Thus, the weights Ck 88 4 ^ apparatus as recited in claim 2 wherein said first 

for the LE 86 pre-filter has its pre-filter characteristic defined plurality of tap weights is adjusted according to a recursive 

in accordance with the filtered output of the LE error filter tap upc j a t e algorithm 

102 presented as a filtered error signal 104. In the cmbodi- 5 ^ apparatus as recited in claim 4 wherein said 

ment the filter takes the form: 5S recurs i ve lap up daie algorithm adjusts said first plurality of 

err n '-err n -a-err (n ^y-bcrr irt ^ (4) tap weights according to a least-mean-squares (LMS) algo- 
rithm. 

where a and b are constants which add to 1, based upon 6. An apparatus as recited in claim 3 wherein said second 

a monic structure. plurality of tap weights is adjusted according to a recursive 

When this is the case the filtered error has a profound null 60 tap update algorithm, 

at DC and a somewhat shallower null at 4 Khz. The error to 7. An apparatus as recited in claim 6 wherein said 

the DFE remains unfiltered in the preferred embodiment, recursive tap update algorithm adjusts said second plurality 

although a filter with another spectral shape may be applied of tap weights according to a least-mean-squares (LMS) 

to the DFE error for some other convergence criteria. For a algorithm. 

LE length of 96 taps and a DFE length of 24 taps, there is 65 8. An apparatus as recited in claim 5 wherein the output 

a twenty-fold typical decrease in convergence time of the of said error filter is used to adjust said first plurality of tap 

embodiment over a conventional implementation. weights. 
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9. An apparatus as recited in claim 7 wherein said error 
signal is used to adjust said second plurality of tap weights. 

10. An apparatus as recited in claim 7 wherein the output 
of said error filter is used to address said second plurality of 
tap weights. 

11. An apparatus as recited in claim 8 wherein the output 
of said error filter is used to adjust said second plurality of 
tap weights. 

12. An apparatus as recited in claim 1 wherein the error 
filter characteristic is related to the spectral shape of a 
communications channel carried over the known transmis- 
sion medium. 

13. An apparatus as recited in claim 1 wherein the error 
filter characteristic is related to a voice-band channel carried 
over a telephone network. 

14. An apparatus as recited in claim 12 wherein the error 
filter characteristic comprises a voice-band channel with 
spectral nulls in the channel pass-band at DC and 4 kHz. 

15. A method of compensating for distortions introduced 
in sample communication signals received over a transmis- 
sion medium, comprising the steps of: 

pre-filtering the sampled communication signals; 

determining one of a plurality of communication states of 
the sampled communication signals in response to the 
pre -filtered communication signals; 

generating an error signal relative to the difference 
between the determined states of said determining step 
and the pre-filtered communication signals; 

identifying a characteristic spectral shape of the transmis- 
sion medium and providing a filtered output of the error 
generated by said generating step, the filtered output 
having an error filter characteristic defined in accor- 
dance with the identified characteristic spectral shape 
of the transmission medium; and 

said pre-filtering step having a pre -filter characteristic 
defined in accordance with the filtered output of the 
error signal. 

16. A method as recited in claim 15 wherein said pre- 
filtering step comprises a linear equalizer (LE) comprising a 
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convolutional summing step for the sampled communication 
signals with a first plurality of tap weights. 

17. A method as recited in claim 16 wherein said deter- 
mining step comprises a decision feedback equalizer (DFE) 
comprising a convolutional summing step for multiple pre- 
viously determined communication states with a second 
plurality of tap weights. 

18. A method as recited in claim 17 wherein the filtered 
output of the error signal is used to adjust said first plurality 
of tap weights. 

19. A method as recited in claim 18 wherein the filtered 
output of the error signal is used to adjust said second 
plurality of tap weights. 

20. An apparatus for compensating for distortions intro- 
duced in sampled communication signals received over a 
transmission medium, comprising: 

means for pre-filtering the sampled communication sig- 
nals; 

means for determining one of a plurality of communica- 
tion states of the sampled communication signals in 
response to the pre-filtered communication signal; 

means for generating an error signal relative to the 
difference between the determined states of said deter- 
mining means and the pre-filtered communication sig- 
nal; 

means for identifying the characteristic spectral shape of 
the transmission system medium and providing a fil- 
tered output of the error signal generated by said 
generating means, the filtered output having an error 
filter characteristic defined in accordance with the 
identified characteristic spectral shape of the transmis- 
sion medium; and 

said pre-filtering means having a pre-filtered characteris- 
tic defined in accordance with the filtered output of the 
error sij 
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